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Technology Focus: Test & Measurement 


® Fused Reality for Enhanced Flight Test Capabilities 

Complex maneuvers can be accomplished without additional aircraft resources or risk. 

Dryden Flight Research Center, Edwards, California 


The feasibility of using Fused Reality- 
based simulation technology to enhance 
flight test capabilities has been investi- 
gated. In terms of relevancy to piloted 
evaluation, there remains no substitute 
for actual flight tests, even when consid- 
ering the fidelity and effectiveness of 
modern ground-based simulators. In ad- 
dition to real-world cueing (vestibular, 
visual, aural, environmental, etc.), flight 
tests provide subtle but key intangibles 
that cannot be duplicated in a ground- 
based simulator. There is, however, a 
cost to be paid for the benefits of flight 
in terms of budget, mission complexity, 
and safety, including the need for 
ground and control-room personnel, ad- 
ditional aircraft, etc. 

A Fused Reality™ (FR) Flight system 
was developed that allows a virtual envi- 
ronment to be integrated with the test air- 
craft so that tasks such as aerial refueling, 
formation flying, or approach and land- 
ing can be accomplished without addi- 
tional aircraft resources or the risk of op- 
erating in close proximity to the ground 
or other aircraft. Furthermore, the dy- 
namic motions of the simulated objects 


can be directly correlated with the re- 
sponses of the test aircraft. The FR Flight 
system will allow real-time observation of, 
and manual interaction with, the cockpit 
environment that serves as a frame for the 
virtual out-the-window scene. 

FR is a mixed-reality approach that em- 
ploys four technologies: live video cap- 
ture, real-time video editing, machine vi- 
sion, and virtual environment simulation. 
Video from the trainee’s perspective is 
sent to a processor that preserves pixels 
in the near-space environment (i.e., cock- 
pit) , and makes transparent the far-space 
environment (outside the cockpit win- 
dows) pixels using blue-screen imaging 
techniques. This bitmap is overlaid on a 
virtual environment and sent to the 
trainee’s helmet-mounted display 
(HMD) . The user can directly view and 
interact with the physical environment, 
while the simulated outside world serves 
as an interactive backdrop. 

The system employs a head-mounted 
camera and display assembly, where the 
camera captures live video from the 
user’s perspective and sends it to a com- 
puter for processing. The window frames 


of the cockpit are bordered with colored 
tape, and when these color-coded bor- 
ders are sensed, the computer keys out 
pixels lying within each window so that 
an underlying virtual scene is seen in 
place of the window pixels. The virtual 
simulation reacts to the user’s head mo- 
tion and control inputs, and the two lay- 
ers — processed video and virtual scene 
— are combined and viewed by the user 
through a head-mounted display. 

Critical hardware challenges included 
selection of color and material of the 
window bordering material, and identi- 
fying a lens filter to allow machine color 
recognition in the presence of bright 
sunlight. Software challenges included 
accommodating for every possible view 
(of one or more window borders), bal- 
ancing sensor noise-smoothing against 
precision loss, and creating a means for 
rapidly calibrating color sensing thresh- 
olds for a given lighting environment. 

This work was done by Ed Bachelder and 
David Klyde of Systems Technology, Inc. for 
Dryden Flight Research Center. Further infor- 
mation is contained in a TSP ( see page 1 ). 
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© Thermography to Inspect Insulation of Large Cryogenic Tanks 

Significant cost and schedule savings may be realized. 

John F. Kennedy Space Center, Florida 


Thermography has been used in the 
past to monitor active, large, cryogenic 
storage tanks. This approach proposes 
to use thermography to monitor new or 
refurbished tanks, prior to filling with 
cryogenic liquid, to look for insulation 
voids. Thermography may provide sig- 
nificant cost and schedule savings if 
voids can be detected early before a tank 
is returned to service. 

The Launch Complex 39 Pad B liq- 
uid hydrogen storage tank at Kennedy 
Space Center has had performance is- 
sues since it was put into service in 
1965. The loss rate from the Pad B tank 
was two to three times more than the 


Pad A tank, which has resulted in a sig- 
nificant cumulative loss of hydrogen 
over more than 40 years of service. It 
has been theorized for years that the 
performance degradation was due to 
an insulation void; however, because of 
the cost and schedule disruption that 
would be required to fix the problem, it 
remained in service until Pad B was 
turned over after its support for the 
Shuttle program was finished. With the 
tank taken out of active service, it was 
confirmed that a major insulation void 
was present. 

Because of the large thermal mass of 
the inner and outer spheres, heat trans- 


fer between surfaces to equalize temper- 
atures can be relatively slow, even when 
the temperature differences between 
the spheres themselves is small. There- 
fore, thermography has been suggested 
as an aid in acceptance testing of the 
tanks before cryogen is introduced to 
any tank, new or refurbished. 

Models suggest that areas without in- 
sulation will heat less rapidly under 
solar illumination than areas with insu- 
lation, due to better thermal contact 
with the inner storage sphere. The re- 
sulting temperature difference across 
the outer shell of the tank should be a 
few degrees Celsius, which can be easily 
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